"Express Mail" Mailing Label No. EL917901710US 

PATENT APPLICATION 
ATTORNEY DOCKET NO. SUN-P6057-ACC 



METHOD AND APPARATUS TO FACILITATE 
DIRECT TRANSFER OF DATA BETWEEN A 
DATA DEVICE AND A NETWORK 
CONNECTION 

Inventors: William T. Zaumen, Andy A. Poggio, David Robinson, and Leo A. 

Hejza 



BACKGROUND 

Field of the Invention 

[0001] The present invention relates to data transfer on a network. More 
specifically, the present invention relates to a method and an apparatus to facilitate 
direct transfer of data between a data device and a network connection. 

Related Art 

[0002] Modern computing systems, coupled with the Internet, allow 
computer users to access a seemingly limitless supply of data. Typically, the 
computer user accesses data on the Internet using a data terminal such as a web 
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browser. This data terminal, in turn, communicates with one or more applications 
such as web servers to retrieve the data. 

[0003] These applications, however, can encounter performance problems 
when multiple data terminals simultaneously access the same server or when high 
5 bandwidth applications such as database backups are running. Simultaneous 
access by multiple data terminals causes a significant amount of data motion 
between the application and the data device supplying or receiving the data. 
Typically, the application receives a request from a data terminal to supply data to 
the data terminal. In response to a request, the application locates the proper data 
10 device, copies the data into the application's data space, and then sends the data 
• within transmission control protocol (TCP) or user datagram protocol (UDP) 
O packets to the data terminal. 

?! [0004] Data can also be moved in the opposite direction, with data within 

\T TCP or UDP packets originating at the data terminal for delivery to a data device. 

1 5 This data is first received into the application's data space, and then the 
, H application moves the data to the data storage device or other device needing the 

iu data. 

if; [0005] Copying data into and out of the application's data space during 

Q these data transfer operations is time consuming and uses a significant amount of 

20 the bandwidth available to the application and other applications, which may be 
running on the same computing device. 

[0006] What is needed is a method and an apparatus that facilitates 
moving data between a data device and a data terminal without the disadvantages 
listed above. 



2 

Attorney Docket No. SUN-P6057-ACC Inventors: Zaumen, et al. 

EJG \\PORSCHE\MY DOCUMENTS\SUN MICROSYSTEMS\SUN-P6057-ACC\SUN-P6057-ACC 



SUMMARY 

[0007] One embodiment of the present invention provides a system that 
facilitates transferring data between a data device and a data terminal across a 
network. The system initializes itself by establishing connections between the 
5 controller, multiplexer, and data device. The system operates by receiving a 
request at a multiplexer from a controller to transfer data from the data device to 
the data terminal. The multiplexer forwards this request to the data device that 
has the requested data. The multiplexer then receives a set of parameters from the 
data device, including the location of the outgoing data within the data device. 

10 The multiplexer moves the data from the data device into an outgoing data stream, 
thereby removing the necessity of first copying the data into the controller. 

[0008] In one embodiment of the present invention, the transmission 
protocol for the outgoing data stream includes transmission control protocol 
(TCP) or user datagram protocol (UDP). 

1 5 [0009] In one embodiment of the present invention, the system receives a 

request at the multiplexer to transfer data from the data terminal to the data 
device. The multiplexer forwards this request to the data device that will receive 
the data. The multiplexer then accepts a set of parameters from the data device, 
including the location for storing the incoming data within the data device. The 

20 multiplexer recovers data from an incoming data stream. This recovered data is 
moved directly to the data device, removing the necessity of first copying the data 
into the controller. 

[0010] In one embodiment of the present invention, the transmission 
protocol for the incoming data stream includes TCP or UDP. 

25 [0011] In one embodiment of the present invention, the data device 

includes a hard disk, a floppy disk, a tape drive, a compact disk, a digital versatile 
disk, a digital video disk, a web camera, or a streaming data source. 
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[0012] In one embodiment of the present invention, the data device 
comprises a component associated with a computer kernel process. 

[0013] In one embodiment of the present invention, the data device 
comprises a component associated with a computer application program. 

[0014] In one embodiment of the present invention, the data device 
comprises a data source component separate from a computer system. 

BRIEF DESCRIPTION OF THE FIGURES 
[0015] FIG. 1 illustrates computer systems coupled together in accordance 

with an embodiment of the present invention. 

[0016] FIG. 2 illustrates multiplexer 104 in accordance with an 

embodiment of the present invention. 

[0017] FIG. 3 is an activity diagram illustrating message flow related to 

time for outgoing data in accordance with an embodiment of the present 

invention. 

[0018] FIG. 4 is an activity diagram illustrating message flow related to 
time for incoming data in accordance with an embodiment of the present 
invention. 

[0019] FIG. 5 is a flowchart illustrating the process of copying data into an 
outgoing message in accordance with an embodiment of the present invention. 

[0020] FIG. 6 is a flowchart illustrating the process of copying data from 
an incoming message in accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION 
[0021] The following description is presented to enable any person skilled 
in the art to make and use the invention, and is provided in the context of a parti- 
cular application and its requirements. Various modifications to the disclosed 
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embodiments will be readily apparent to those skilled in the art, and the general 
principles defined herein may be applied to other embodiments and applications 
without departing from the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodiments shown, but is 
5 to be accorded the widest scope consistent with the principles and features 
disclosed herein. 

[0022] The data structures and code described in this detailed description 
are typically stored on a computer readable storage medium, which may be any 
device or medium that can store code and/or data for use by a computer system. 
10 This includes, but is not limited to, magnetic and optical storage devices such as 
disk drives, magnetic tape, CDs (compact discs) and DVDs (digital versatile discs 

g. — 

q or digital video discs), and computer instruction signals embodied in a 

SI transmission medium (with or without a carrier wave upon which the signals are 

H; modulated). For example, the transmission medium may include a 

M* 1 5 communications network, such as the Internet. 

7 Computer Systems. 

[0023] FIG. 1 illustrates computer systems coupled together in accordance 
q. with an embodiment of the present invention. Controller 102 and data device 106 

20 are coupled to multiplexer 1 04. Data terminal 1 1 0 is coupled to multiplexer 1 04 
across network 108. Controller 102 is a process or thread that uses data to 
network direct (DND) services to direct data associated with a socket to or from 
DND data providers. Controller 102 can include such processes as web servers, 
file transfer protocol (ftp) servers, and network file system (NFS) servers. 
25 [0024] Data device 106 is a process or kernel service that acts as a source 

or a sink for data. Data device 106 can include magnetic, optical, and magneto- 
optical storage devices, storage devices based on flash memory and/or battery- 
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backed up memory, as well as streaming data sources such as web cameras and 
the like. Upon completion of a data transfer, data device 106 sends a "return" or 
completion message to multiplexer 104, which is then forwarded to controller 
102. 

5 [0025] Multiplexer 104 is a driver or device that collects or distributes 

data traffic from or to a data stream such as a network connection. Examples of 
multiplexer 104 include a DND enabled TCP implementation or custom packet 
accelerating hardware. 

[0026] Data terminal 1 10 is a client of controller 102. Data terminal 110 

10 includes web browsers, ftp clients, NFS clients, and the like. Data terminal 110 
couples to multiplexer 104 across network 108. Network 108 can generally 
include any type of wire or wireless communication channel capable of coupling 
together computing nodes. This includes, but is not limited to, a local area 
network, a wide area network, or a combination of networks. In one embodiment 

1 5 of the present invention, network 1 08 includes the Internet. 

[0027] Data passing between data terminal 1 10 and either controller 102 
or data device 106 will pass through multiplexer 104, which provides the interface 
between network 108 and an internal network coupling controller 102 and data 
device 106 to multiplexer 104. Multiplexer 104 will include network interfaces 

20 and may terminate TCP and UDP connections. 

Multiplexer 104 

[0028] FIG. 2 illustrates multiplexer 104 in accordance with an 
embodiment of the present invention. Multiplexer 104 includes request receiver 
25 202, request forwarder 204, parameter acceptor 206, connection establisher 208, 
data mover 210, and stream handler 212. 
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[0029] Request receiver 202 receives requests from controller 102 to 
transfer data between data device 106 and data terminal 110. These requests may 
include requests to transfer data from data device 106 to data terminal 110 and 
requests to transfer data from data terminal 1 10 to data device 106. 
5 [0030] After request receiver 202 receives a request to transfer data, 

request forwarder 204 forwards the request to data device 106. Note that 
controller 102 may also include remote direct memory access (RDMA) 
parameters in a request, so that data device 106 will obtain most of the request 
data directly from controller 102. 

10 [0031] Parameter acceptor 206 accepts a set of parameters from data 

device 106. This set of parameters is sent in response to data device 106 receiving 
the request. The set of parameters includes the location within data device 106 
where outgoing data resides or where to put incoming data. This set of parameters 
may include other information such as size of the outgoing data and the like. 

1 5 [0032] Data mover 210 moves data between data device 1 06 and 

multiplexer 104 across the RDMA connection. This data can move either 
direction between data device 106 and multiplexer 104, depending on the request 
from controller 102. Data completion messages are sent from multiplexer 104 to 
data device 106 when the data transfer is completed and multiplexer 104 can 

20 determine that the data will not have to be transferred again. A data completion 
message indicates to data device 106 that data device 106 may reclaim resources 
associated with the set of parameters. 

[0033] Stream handler 212 handles both outbound and inbound data 
streams across network 108. For an outbound data stream, stream handler 212 

25 inserts data from data device 106 into the outbound data stream. For example, 

stream handler 212 inserts data into TCP packets on a TCP connection established 
by controller 102 between controller 102 and data terminal 110. For an inbound 
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Li- 



data stream, multiplexer 104 strips incoming data from the inbound data stream 
and passes it directly to data device 106. Controller 102 is thus relieved of having 
to copy data into its own memory and subsequently moving the copied data to the 
proper destination. 

5 

Outgoing Message Flow 

[0034] FIG. 3 is an activity diagram illustrating message flow related to 
time for outgoing data in accordance with an embodiment of the present 
invention. Controller 102 first passes request 302 to multiplexer 104. 
10 Multiplexer 104, in turn, sends forwarded request 304 to data device 106. 

[0035] Data device 106 responds to forwarded request 304 with 
parameters 306. Parameters 306 includes the location of the outgoing data within 
data device 106. Multiplexer 104 then establishes RDMA request 308 using 
parameters 306. 

15 [0036] Next, multiplexer 104 initiates an RDMA operation to obtain data 

310 from data device 106. Multiplexer 104 then places data 310 into data stream 
3 12 for deliver to data terminal 110. Upon completion of the data transfer, data 
device 106 sends completion 314 to multiplexer 104. Multiplexer 104 then sends 
forwarded completion 316 to controller 102. Multiplexer 104 also sends data 

20 completion 3 1 8 to data device 106. Note that controller 102 will typically block 
after sending request 302 and will remain blocked until receiving forwarded 
completion 316. Multiplexer 104 also sends data device 106 data completion 
messages when resources associated with the set of parameters provided by data 
device 106 are no longer needed by multiplexer 104. 

25 
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Incoming Message Flow 

[0037] FIG. 4 is an activity diagram illustrating message flow related to 
time for incoming data in accordance with an embodiment of the present 
invention. Controller 102 first passes request 402 to multiplexer 104. 
5 Multiplexer 104, in turn, sends forwarded request 404 to data device 106. 

[0038] Data device 106 responds to forwarded request 404 with 
parameters 406. Parameters 406 includes the location specifying where to place 
the incoming data within data device 106. 

[0039] Multiplexer 104 receives data stream 410 from data terminal 110. 
10 Multiplexer 104 then strips the incoming data from data stream 410 and delivers 
the data to data device 106 as data 412. Upon completion of the data transfer, 
data device 106 sends completion 414 to multiplexer 104. Multiplexer 104 sends 
forwarded completion 416 to controller 102. Multiplexer 104 also sends data 
completion 418 to data device 106. Controller 102 will typically block after 
1 5 sending request 402 and will remain blocked until receiving forwarded 

completion 416. Multiplexer 104 also sends data device 106 data completion 
messages when resources associated with the set of parameters provided by data 
device 106 are no longer needed by multiplexer 104. 

20 Copying Outgoing Data 

[0040] FIG. 5 is a flowchart illustrating the process of copying data into an 
outgoing message in accordance with an embodiment of the present invention. 
The system starts when multiplexer 104 receives a request from controller 102 to 
transfer data from data device 106 to data terminal 110 (step 502). Next, 
25 multiplexer 104 forwards the request to data device 106 (step 504). 

[0041] Multiplexer 104 then receives a set of parameters, including the 
location of the outgoing data, from data device 106 (step 506). Multiplexer 104 
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then sends an RDMA request to data device 106 (step 508). Multiplexer 104 next 
moves data from data device 106 across a data connection (step 510). This data 
connection can include an RDMA connection. Next, multiplexer 104 inserts this 
data into the outgoing data stream (step 512). Upon completion of the data 
transfer, multiplexer 104 receives a "return" or completion message from data 
device 106 (step 514). Next, multiplexer 104 forwards the completion message to 
controller 102 (step 516). Finally, multiplexer 104 sends a data completion 
message to data device 106 (step 518). 

Copying Incoming Data 

[0042] FIG. 6 is a flowchart illustrating the process of copying data from 
an incoming message in accordance with an embodiment of the present invention. 
The system starts when multiplexer 104 receives a request from controller 102 to 
transfer data to data device 106 from data terminal 110 (step 602). Next, 
multiplexer 104 forwards the request to data device 106 (step 604). 

[0043] Multiplexer 104 then receives a set of parameters, including the 
location where to place the incoming data within data device 106 (step 606). 
Multiplexer 104 then recovers the data from the incoming data stream (step 610). 
Next, multiplexer 104 moves the data to data device 106 across a data connection 
(step 612). This data connection can include an RDMA connection. Then, 
multiplexer 104 sends a data completion message to data device 106 (step 613). 
Upon completion of the data transfer, multiplexer 104 receives a "return" or 
completion message from data device 106 (step 614). Finally, multiplexer 104 
forwards the completion message to controller 102 and sends data completion 
messages to data device 106 to indicate that resources associated with the set of 
parameters are no longer needed (step 616). 
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[0044] The foregoing descriptions of embodiments of the present 
invention have been presented for purposes of illustration and description only. 
They are not intended to be exhaustive or to limit the present invention to the 
forms disclosed. Accordingly, many modifications and variations will be apparent 
to practitioners skilled in the art. Additionally, the above disclosure is not 
intended to limit the present invention. The scope of the present invention is 
defined by the appended claims. 



11 

Attorney Docket No. SUN-P6057-ACC Inventors: Zaumen, et aL 

EJG \\PORSCHE\MY DOCUMENTS\SUN MICROS YSTEMS\SUN-P6057-ACC\SUN-P6057-ACC 



